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DETAILED ACTION 



1. 



Claims 1-73 have been submitted for examination. 



2. 



Claims 1-9, 12-31, and 34-73 have been rejected. 



3. 



Claims 10-11 and 32-33 have been objected. 



Claim Objections 



4. Claim 46 is objected to because of the following infonnalities: claim 46 contains 
a dot on line 2. Every claim can only be represented by a single sentence. Appropriate 
correction is required. 

Claim Rejections • 35 USC § 102 

The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 



5. Claims 1-9. 12-13, 16-20, 22-31. 34-35, 38-42, 44-54, and 56-73 are rejected 
under 35 U.S.C. 102(b) as being anticipated by Simard et al. ("Transformation 
Invariance in Pattern Recognition - Tangent Distance and Tangent Propagation"). 



states. 



Claim 1 

Simard teaches a method comprising: 
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generating derivatives (page 4, lines 7-4 from the bottom; disclosed as tangent 
vectors or Lie derivatives) of a nonlinear invariance transformation (page 4, paragraph 
2) at a training data point with respect to a transfomnation parameter (page 9, chapter 
2.1, first paragraph), the training data point representing one of a plurality of training 
patterns (page 4, paragraph 4); and 

generating a classifier representation based on the derivatives for classifying a 
test pattern in the presence of the nonlinear invariance transfonnation (page 18, chapter 
3; generating a classifier is disclosed by incorporating invariance into a classification 
function). 

Claim 2 

Simard teaches the method of claim 1 further comprising: classifying the test 
pattern based on the classifier representation (page 1 , chapter 1 , lines 5-7). 

Claim 3 

Simard teaches the method of claim 1 further comprising: receiving the plurality 
of training patterns; and characterizing one of the training patterns to provide the 
training data point (page 18, last paragraph). 

Claim 4 

Simard teaches the method of claim 1 further comprising: classifying the test 
pattern based on the classifier representation to provide a classification signal (page 1 , 
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chapter 1 , lines 5-7; disclosed as classifying digit images); and inputting the test pattem 
to the operation of generating derivatives as a training pattern, responsive to the 
classifying operation (page 4, paragraph 4; disclosed by generating a tangent plane of a 
pattern). 

Claim 5 

Simard teaches the method of claim 1 further comprising: classifying the test 
pattern based on the classifier representation to provide a classification signal (page 1 , 
chapter 1 , lines 5-7; disclosed as classifying digit images); inputting the test pattern to 
the operation of generating derivatives as a training pattern (page 4, paragraph 4; 
disclosed by generating a tangent plane of a pattern); and inputting the classification 
signal to the operation of generating derivatives in association with the test pattern 
(page 20, last paragraph before chapter 3.1; disclosed by the tangent propagation 
algorithm analogous to backpropagation; see also page 22, lines 4-6). 

Claim 6 

Simard teaches the method of claim 1 wherein the non-linear invariant 
transformation is represented by a Taylor expansion polynomial (page 4, equation (2)). 

Claim 7 

Simard teaches the method of claim 1 wherein the nonlinear invariance 
transfonnation models a rotation of an individual training pattern (page 29, Rotation). 
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Claim 8 

Simard teaches the method of claim 1 wherein the nonlinear invariance 
transfonnatlon models a sheering in an individual training pattern (page 13, paragraph 
2, lines 5-8; sheering is included in hyperbolic transfonnatlons). 

Claim 9 

Simard teaches the method of claim 1 wherein the nonlinear invariance 
transfomnation models a translation in an individual training pattern (page 29, X- 
translation and Y-translation). 

Claim 12 

Simard teaches the method of claim 1 wherein the nonlinear invariance 
transfomnation models a scaling of an individual training pattern (page 30, Scaling). 

Claim 13 

Simard teaches the method of claim 1 wherein the nonlinear invariance 
transformation models a change in line thickness in an individual training pattern (page 
30, Thickening). 



Claim 16 
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Simard teaches the method of claim 1 wherein the test pattern includes an image 
(page 1 , Introduction, lines 5-7). 

Claim 17 

Simard teaches the method of claim 1 wherein the test pattern includes an audio 
input (page 5, paragraph 2, speech). 

Claim 18 

Simard teaches the method of claim 1 wherein the test pattem includes a 
handwriting pattern (page 1 , Introduction, lines 5-7). 

Claim 19 

Simard teaches the method of claim 1 wherein the test pattern includes a time 
series (page 5, paragraph 2, temporal signals). 

Claim 20 

Simard teaches the method of claim 1 further comprising: restricting a range of 
the transfomiation parameter to a closed interval on a line of real numbers (considering 
the fact that the parameters define the transformation values such as translation, 
scaling and rotation, it is inherent for these parameters to belong to a limited range of 
values). 
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Claim 22 

Simard teaches the method of claim 1 wherein the operation of generating 
derivatives comprises: generating derivatives of the nonlinear invariance transformation 
at the training data point with respect to a plurality of transformation parameters (page 
9, chapter 2.1 , first paragraph; disclosed by having a vector of parameters). 

Claim 23 

Simard teaches a computer program product encoding a computer program for 
executing on a computer system a computer process, the computer process 
comprising: 

generating derivatives (page 4, lines 7-4 from the bottom; disclosed as tangent 
vectors or Lie derivatives) of a nonlinear invariance transfomriation (page 4, paragraph 
2) at a training data point with respect to a transformation parameter (page 9, chapter 
2.1, first paragraph), the training data point representing one of a plurality of training 
patterns (page 4, paragraph 4); and 

generating a classifier representation based on the derivatives for classifying a 
test pattern in the presence of the nonlinear invariance transformation (page 18, chapter 
3; generating a classifier is disclosed by incorporating invariance into a classification 
function). 



Claim 24 
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Simard teaches the computer program product of claim 23 wherein the computer 
process further comprises: classifying the test pattern based on the classifier 
representation (page 1 , chapter 1 , lines 5-7). 

Claim 25 

Simard teaches the computer program product of claim 23 wherein the computer 
process further comprises: receiving the plurality of training patterns; and characterizing 
one of the training patterns to provide the training data point (page 18, last paragraph). 

Claim 26 

Simard teaches the computer program product of claim 23 wherein the computer 
process further comprises: classifying the test pattern based on the classifier 
representation (page 1, chapter 1, lines 5-7; disclosed as classifying digit images); and 
inputting the test pattern to the operation of generating derivatives as a training pattern, 
responsive to the classifying operation (page 4, paragraph 4; disclosed by generating a 
tangent plane of a pattern). 

Claim 27 

Simard teaches the computer program product of claim 23 wherein the computer 
process further comprises: classifying the test pattern based on the classifier 
representation to provide a classification signal (page 1 , chapter 1 , lines 5-7; disclosed 
as classifying digit images); inputting the test pattern to the operation of generating 
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derivatives as a training pattern (page 4, paragraph 4; disclosed by generating a 
tangent plane of a pattern); and inputting the classification signal to the operation of 
generating derivatives in association with the test pattern (page 20, last paragraph 
before chapter 3.1; disclosed by the tangent propagation algorithm analogous to 
backpropagation; see also page 22. lines 4-6). 

Claim 28 

Simard teaches the computer program product of claim 23 wherein the non-linear 
invariant transformation is represented by a Taylor expansion polynomial (page 4, 
equation (2)). 

Claim 29 

Simard teaches the computer program product of claim 23 wherein the nonlinear 
invariance transformation models a rotation of an individual training pattern (page 29, 
Rotation). 

Claim 30 

Simard teaches the computer program product of claim 23 wherein the nonlinear 
invariance transformation models a sheering in an individual training pattern (page 13, 
paragraph 2, lines 5-8; sheering is included in hyperbolic transformations). 



Claim 31 
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Simard teaches the computer program product of claim 23 wherein the nonlinear 
invariance transformation models a translation in an individual training pattern (page 29, 
X-translation and Y-translation). 

Claim 34 

Simard teaches the computer program product of claim 23 wherein the nonlinear 
invariance transfonnation models a scaling of an individual training pattern (page 30, 
Scaling). 

Claim 35 

Simard teaches the computer program product of claim 23 wherein the nonlinear 
invariance transformation models a change in line thickness in an individual training 
pattern (page 30, Thickening). 

Claim 38 

Simard teaches the computer program product of claim 23 wherein the test 
pattern includes an image (page 1 , Introduction, lines 5-7). 

Claim 39 

Simard teaches the computer program product of claim 23 wherein the test 
pattern includes an audio input (page 5, paragraph 2, speech). 
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Claim 40 

Simard teaches the computer program product of claim 23 wherein the test 
pattern includes a handwriting pattern (page 1, Introduction, lines 5-7). 

Claim 41 

Simard teaches the computer program product of claim 23 wherein the test 
pattern includes a time series (page 5, paragraph 2, temporal signals). 

Claim 42 

Simard teaches the computer program product of claim 23 wherein the computer 
process further comprises: restricting a range of the transformation parameter to a 
closed interval on a line of real numbers (considering the fact that the parameters define 
the transformation values such as translation, scaling and rotation, it is inherent for 
these parameters to belong to a limited range of values). 

Claim 44 

Simard teaches the computer program product of claim 23 wherein the operation 
of generating derivatives comprises: generating derivatives of the nonlinear invariance 
transfomnation at the training data point with respect to a plurality of transformation 
parameters (page 9, chapter 2.1, first paragraph; disclosed by having a vector of 
parameters). 
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Claim 45 

Simard teaches a system comprising: 

a derivative generator generating derivatives (page 4, lines 7-4 from the bottom; 
disclosed as tangent vectors or Lie derivatives) of a nonlinear Invariance transfomnation 
(page 4, paragraph 2) at a training data point with respect to a transformation parameter 
(page 9, chapter 2.1, first paragraph), the training data point representing one of a 
plurality of training patterns (page 4, paragraph 4); and 

a classifier representation generator generating a classifier representation based 
on the derivatives for classifying a test pattern in the presence of the nonlinear 
invariance transformation (page 18, chapter 3; generating a classifier is disclosed by 
incorporating invariance into a classification function). 

Claim 46 

Simard teaches the system of claim 45 further comprising: a classifier classifying 
the test pattern based on the classifier representation (page 1, chapter 1, lines 5-7; 
disclosed as classifying digit images) a training data characterizer receiving the plurality 
of training patterns and characterizing one of the training patterns to provide the training 
data point (page 4, paragraph 4; disclosed by generating a tangent plane of a pattern). 



Claim 47 
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Simard teaches the system of claim 45 wherein the derivative generator inputs 
the test pattern as a training pattern (page 18, last paragraph). 

Claim 48 

Simard teaches the system of claim 45 further comprising: a classifier classifying 
the test pattern based on the classifier representation to provide a classification signal 
(page 1, chapter 1, lines 5-7; disclosed as classifying digit images), wherein the 
derivative generator inputs the test pattern as a training pattern and inputs the 
classification signal in association with the test pattern (page 4, paragraph 4; disclosed 
by generating a tangent plane of a pattern). 

Claim 49 

Simard teaches the system of claim 45 wherein the non-linear invariant 
transformation is represented by a Taylor expansion polynomial (page 4, equation (2)). 

Claim 50 

Simard teaches the system of claim 45 wherein the test pattern includes an 
image (page 1, Introduction, lines 5-7). 

Claim 51 

Simard teaches the system of claim 45 wherein the test pattern includes an audio 
input (page 5, paragraph 2, speech). 
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Claim 52 

Simard teaches the system of claim 45 wherein the test pattern includes a 
handwriting pattern (page 1, Introduction, lines 5-7). 

Claim 53 

Simard teaches the system of claim 45 wherein the test pattern includes a time 
series (page 5, paragraph 2, temporal signals). 

Claim 54 

Simard teaches the system of claim 45 wherein a range of the transformation 
parameter is restricted to a closed interval on a line of real numbers (considering the 
fact that the parameters define the transfomiation values such as translation, scaling 
and rotation, it is inherent for these parameters to belong to a limited range of values). 

Claim 56 

Simard teaches the system of claim 45 wherein the classifier representation 
generator generates derivatives of the nonlinear invariance transfomiation at the 
training data point with respect to a plurality of transformation parameters (page 9, 
chapter 2.1 , first paragraph; disclosed by having a vector of parameters). 



Claim 57 
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Simard teaches a method comprising: characterizing a plurality of training 
patterns, each training pattern corresponding to a training data point in a feature space 
(page 32, last paragraph); detennining a classification for each training pattern (page 1, 
chapter 1, lines 5-7); generating derivatives (page 4, lines 7-4 from the bottom; 
disclosed as tangent vectors or Lie derivatives) of a nonlinear invarlance transformation 
(page 4, paragraph 2) at individual training data points with respect to a transfomnation 
parameter (page 9, chapter 2.1, first paragraph); and generating an optimized weight 
vector, based on the derivatives and the classification of each training pattem, for 
classifying a test pattern in the presence of the nonlinear invarlance transformation 
(page 18, last paragraph through page 19, first paragraph; generating vector w which 
minimizes the energy function). 

Claim 58 

Simard teaches the method of claim 57 further comprising: classifying the test 
pattern based on the optimized weight vector (page 1 , chapter 1 , lines 5-7; classifying is 
based on the vector since the invarlance is incorporated directly into a classification 
function, see page 18, chapter 3, paragraph 1). 

Claim 59 

Simard teaches the method of claim 57 further comprising: classifying the test 
pattem based on the optimized weight vector to provide a classification signal (page 1 , 
chapter 1, lines 5-7; disclosed as classifying digit images; classifying is based on the 
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vector since the invariance is incorporated directly into a classification function, see 
page 18, chapter 3, paragraph 1); and inputting the test pattern to the operation of 
generating derivatives as a training pattern, responsive to the classifying operation 
(page 4, paragraph 4; disclosed by generating a tangent plane of a pattern). 

Claim 60 

SImard teaches the method of claim 57 further comprising: classifying the test 
pattern based on the optimized weight vector to provide a classification signal (page 1 , 
chapter 1 , lines 5-7; disclosed as classifying digit images; classifying is based on the 
vector since the invariance is incorporated directly into a classification function, see 
page 18, chapter 3, paragraph 1); inputting the test pattern to the operation of 
generating derivatives as a training pattern (page 4, paragraph 4; disclosed by 
generating a tangent plane of a pattern); and inputting the classification signal to the 
operation of generating derivatives in association with the test pattem (page 20, last 
paragraph before chapter 3.1; disclosed by the tangent propagation algorithm 
analogous to backpropagatlon; see also page 22, lines 4-6). 

Claim 61 

Simard teaches the method of claim 57 wherein the non-linear invariant 
transfonnation is represented by a Taylor expansion polynomial (page 4, equation (2)). 



Claim 62 
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Simard teaches a computer program product encoding a computer program for 
executing on a computer system a computer process, the computer process 
comprising: characterizing a plurality of training patterns, each training pattern 
corresponding to a training data point in a feature space (page 32, last paragraph); 
determining a classification for each training pattern (page 1, chapter 1, lines 5-7); 
generating derivatives (page 4, lines 7-4 from the bottom; disclosed as tangent vectors 
or Lie derivatives) of a nonlinear invariance transfomiation (page 4, paragraph 2) at 
individual training data points with respect to a transformation parameter (page 9, 
chapter 2.1, first paragraph); and generating an optimized weight vector, based on the 
derivatives and the classification of each training pattern, for classifying a test pattern in 
the presence of the nonlinear invariance transformation (page 18, last paragraph 
through page 19, first paragraph; generating vector w which minimizes the energy 
function). 

Claim 63 

Simard teaches the computer program product of claim 62 wherein the computer 
process further comprises: classifying the test pattern based on the optimized weight 
vector (page 1, chapter 1, lines 5-7; classifying is based on the vector since the 
invariance is incorporated directly into a classification function, see page 18, chapter 3, 
paragraph 1). 



Claim 64 
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Simard teaches the computer program product of claim 62 wherein the computer 
process further comprises: characterizing one of the training patterns to provide the 
training data point (page 18, last paragraph). 

Claim 65 

Simard teaches the computer program product of claim 62 wherein the computer 
process further comprises: classifying the test pattern based on the optimized weight 
vector (page 1, chapter 1, lines 5-7; disclosed as classifying digit images; classifying is 
based on the vector since the invariance is incorporated directly into a classification 
function, see page 18, chapter 3, paragraph 1); and inputting the test pattern to the 
operation of generating derivatives as a training pattern, responsive to the classifying 
operation (page 4, paragraph 4; disclosed by generating a tangent plane of a pattern). 

Claim 66 

Simard teaches the computer program product of claim 62 wherein the computer 
process further comprises: classifying the test pattern based on the optimized weight 
vector to provide a classification signal (page 1, chapter 1, lines 5-7; disclosed as 
classifying digit images; classifying is based on the vector since the invariance is 
incorporated directly into a classification function, see page 18, chapter 3, paragraph 1); 
inputting the test pattern to the operation of generating derivatives as a training pattern 
(page 4, paragraph 4; disclosed by generating a tangent plane of a pattern); and 
inputting the classification signal to the operation of generating derivatives in 



Application/Control Number: 1 0/697,727 Page 1 9 

Art Unit: 2121 

association with the test pattern (page 20, last paragraph before chapter 3.1; disclosed 
by the tangent propagation algorithm analogous to backpropagation; see also page 22, 
lines 4-6). 

Claim 67 

Simard teaches the computer program product of claim 62 wherein the non-linear 
invariant transformation is represented by a Taylor expansion polynomial (page 4, 
equation (2)). 

Claim 68 

Simard teaches a system comprising: a training data characterizer characterizing 
a plurality of training patterns, each training pattern corresponding to a training data 
point in a feature space (page 32, last paragraph) and determining a classification for 
each training pattern (page 1 , chapter 1 , lines 5-7); a derivative generator generating 
derivatives (page 4, lines 7-4 from the bottom; disclosed as tangent vectors or Lie 
derivatives) of a nonlinear invariance transformation (page 4, paragraph 2) at individual 
training data points with respect to a transformation parameter (page 9, chapter 2.1 , first 
paragraph); and a classifier representation generator generating an optimized weight 
vector, based on the derivatives and the classification of each training pattern, for 
classifying a test pattern in the presence of the nonlinear invariance transfomiation 
(page 18, last paragraph through page 19, first paragraph; generating vector w which 
minimizes the energy function). 
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Claim 69 

Simard teaches the system of claim 68 further comprising: a classifier classifying 
the test pattern based on the classifier representation (page 1 , chapter 1 , lines 5-7). 

Claim 70 

Simard teaches the system of claim 68 further comprising: a training data 
characterizer receiving the plurality of training patterns and characterizing one of the 
training patterns to provide the training data point (page 18, last paragraph). 

Claim 71 

Simard teaches the system of claim 68 wherein the derivative generator inputs 
the test pattern as a training pattern (page 4, paragraph 4; disclosed by generating a 
tangent plane of a pattern). 

Claim 72 

Simard teaches the system of claim 68 further comprising: a classifier classifying 
the test pattern based on the classifier representation to provide a classification signal 
(page 1, chapter 1, lines 5-7; disclosed as classifying digit images), wherein the 
derivative generator inputs the test pattern as a training pattern and inputs the 
classification signal in association with the test pattern (page 4, paragraph 4; disclosed 
by generating a tangent plane of a pattern). 
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Claim 73 

Simard teaches the system of claim 68 wherein the non-linear invariant 
transformation is represented by a Taylor expansion polynomial (page 4, equation (2)). 

Claim Rejections - 35 USC § 103 
The following is a quotation of 35 U.S.C. 103(a) which fonns the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary sl^ill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

6. Claims 14-15 and 36-37 are rejected under 35 U.S.C. 103(a) as being 

unpatentable over Simard et al. ("Transfonnation Invariance in Pattern Recognition - 

Tangent Distance and Tangent Propagation") in view of Williams et al. (US Patent No. 

6.178.261). 

Claim 14 

Simard teaches the method of claim 1 . 

Simard does not expressly teach that the nonlinear invariance transformation 
models a change in frequency composition of an individual training pattern. 

Williams teaches extending the methodology of character recognition to time- 
frequency representations of signals by treating the signals as Images (col. 10. lines 45- 
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50; changes in duration and frequency corresponds to image transfonnation, such as 
scaling). 

Simard and Williams are analogous art since they are both related to pattern 
recognition. At the time of the invention, it would have been obvious to a person of 
ordinary skill in the art to include the invariance transfomiation used for character 
recognition from Simard and combine it with time-frequency representation from 
Williams. Simard disclosed the possibility of using his algorithm for speech recognition 
(page 5, paragraph 1). However, Simard also mentions that it is not clear to what 
transformation the classification is invariant (page 33, first whole paragraph). Therefore, 
it would be useful to. combine the inventions of Simard and Williams to provide the 
invariant transfomiations for speech recognition. Therefore, it would have been obvious 
to modify Simard in view of Williams by treating time-frequency signals as images and 
applying scaling and translation transformations conresponding to changes In frequency 
and duration. 

Claim 15 

Simard teaches the method of claim 1 . 

Simard does not expressly teach that the nonlinear invariance transformation 
models a change in duration of an individual training pattern. 

Williams teaches extending the methodology of character recognition to time- 
frequency representations of signals by treating the signals as images (col. 10, lines 45- 
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50; changes in duration and frequency corresponds to image transformation, such as 
scaling). 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to include the invariance transformation used for character recognition 
from Simard and combine it with time-frequency representation from Williams using the 
same motivation as in claim 14 above. 

Claim 36 

Simard teaches the computer program product of claim 23. 

Simard does not expressly teach that the nonlinear invariance transformation 
models a change in frequency composition of an individual training pattern. 

Williams teaches extending the methodology of character recognition to time- 
frequency representations of signals by treating the signals as images (col. 10, lines 45- 
50; changes in duration and frequency corresponds to image transformation, such as 
scaling). 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to include the invariance transformation used for character recognition 
from Simard and combine it with time-frequency representation from Williams using the 
same motivation as in claim 14 above. 

Claim 37 

Simard teaches the computer program product of claim 23. 
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Simard does not expressly teach that the nonlinear invariance transformation 
models a change in duration of an individual training pattern. 

Williams teaches extending the methodology of character recognition to time- 
frequency representations of signals by treating the signals as images (col. 10, lines 45- 
50; changes in duration and frequency corresponds to image transformation, such as 
scaling). 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to include the invariance transformation used for character recognition 
from Simard and combine it with time-frequency representation from Williams using the 
same motivation as in claim 14 above. 

7. Claims 21, 43 and 55 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Simard et al. ("Transformation Invariance in Pattern Recognition - Tangent 
Distance and Tangent Propagation") in view of Haasdonk ("Tangent Distance Kernels 
for Support Vector Machines"). 

Claim 21 

Simard teaches the method of claim 1 . 

Simard does not expressly teach representing a scalar product of the classifier 
representation with the derivatives of the nonlinear invariance transfomiation at the 
training data point with respect to the transformation parameter by a nonlinear positive 
definite real-valued kernel function. 
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Haasdonk teaches representing a scalar product of the classifier representation 
(page 866, chapter 4, first paragraph) with the derivatives of the nonlinear invariance 
transformation at the training data point with respect to the transformation parameter 
(page 865. chapter 2, Tangent distance, which comes from the concept introduced by 
Simard) by a nonlinear positive definite real-valued kernel function (page 866, left 
column, last paragraph - right column first paragraph). 

Simard and Haasdonk are analogous art since they are both directed to 
classification using invariant transformation and tangent distance. At the time of the 
invention, it would have been obvious to a person of ordinary skill in the art to include 
the kernel function from Haasdonk and combine it with invariant transformation using 
derivatives from Simard. The reason for doing so would be to improve the classification 
performance (Haasdonk, page 867, left column, last paragraph). Therefore, it would 
have been obvious to modify Simard in view of Haasdonk by combining kernel function 
with tangent information. 

Claim 43 

Simard teaches the computer program product of claim 23. 

Simard does not expressly teach representing a scalar product of the classifier 
representation with the derivatives of the nonlinear invariance transformation at the 
training data point with respect to the transformation parameter by a nonlinear positive 
definite real-valued kernel function. 
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Haasdonk teaches representing a scalar product of the classifier representation 
(page 866, chapter 4, first paragraph) with the derivatives of the nonlinear invariance 
transfomiation at the training data point with respect to the transformation parameter 
(page 865, chapter 2, Tangent distance, which comes from the concept introduced by 
Simard) by a nonlinear positive definite real-valued kernel function (page 866, left 
column, last paragraph - right column first paragraph). 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to include the kernel function from Haasdonk and combine it with invariant 
transfomiation using derivatives from Simard using the same motivation as in claim 21 
above. 

Claim 55 

Simard teaches the system of claim 45. 

Simard does not expressly teach wherein a nonlinear positive definite real-valued 
kernel function represents a scalar product of the classifier representation with the 
derivatives of the nonlinear invariance transformation at the training data point with 
respect to the transformation parameter. 

Haasdonk teaches representing a scalar product of the classifier representation 
(page 866, chapter 4, first paragraph) with the derivatives of the nonlinear invariance 
transfomiation at the training data point with respect to the transformation parameter 
(page 865, chapter 2, Tangent distance, which comes from the concept introduced by 
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Simard) by a nonlinear positive definite real-valued kernel function (page 866, left 
column, last paragraph - right column first paragraph). 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to include the kernel function from Haasdonk and combine it with invariant 
transformation using derivatives from Simard using the same motivation as in claim 21 
above. 

Allowable Subject Matter 

8. Claims 10-11 and 32-33 are objected to as being dependent upon a rejected 
base claim, but would be allowable if rewritten in independent form including all of the 
limitations of the base claim and any intervening claims. 

The following is a statement of reasons for the indication of allowable subject 
matter: the prior art of record taken alone or in combination fails to teach the nonlinear 
invariance transformation modeling a change in lighting angle from claims 10 and 32, or 
modeling a change in brightness from claims 11 and 33. Specifically, since the closest 
prior art of Simard et al. is directed to character recognition, there would be no obvious 
reason to use changes in brightness and lighting angle as nonlinear invariance 
transformations. 

Conclusion 

The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. Simard (US Patent No. 5,422,961) teaches apparatus and 
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method for improving recognition of patterns by prototype transformation. Denker et al. 
(US Patent No. 5,572,628) teaches using invariant transfomiations for pattern 
recognition. Brown et al. (US Patent No. 5,768,420) teaches method and apparatus for 
handwriting recognition using invariant features. Bartiett et al. (US App. No. 
2005/0071300) teaches kernels and methods for selecting kernels for use in learning 
machines. Zhang et al. (US Patent No. 6,996,549) teaches computer-aided image 
analysis. Scholkopf et al. teaches "Incorporating invariances in support vector learning 
machines". Chapelle teaches "Incorporating invariances in nonlinear support vector 
machines". 
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